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Abstract. We study the spectrum of the product of two Toeplitz operators. Assume that 
the symbols of these operators are continuous and real- valued and that one of them is non- 
negative. We prove that the spectrum of the product of finite section Toeplitz matrices 
converges to the spectrum of the product of the semi-infinite Toeplitz operators. We give an 
example showing that the supremum of this set is not always the supremum of the product 
of the two symbols. Finally, we provide an application in probability which is the first 
motivation of this study. More precisely, we obtain a large deviation principle for Gaussian 
quadratic forms. 



1. Introduction 

For any bounded measurable real function / on the torus T = M/27rZ, the £ 2 (N) Toeplitz 
and Hankel operators are respectively given by 



(1-1) T(/) = f/ i _ i ). and H(f)=(f i+j+1 

where (f n ) stands for the sequence of Fourier coefficients of /. We refer to the book of 
Bottcher and Silbermann [3] for a general presentation of Toeplitz operators. A well-known 
identity between the product T(f)T(g) and T(fg) is 

(1-2) T(fg) - T(f)T(g) = H(f)H(Jg) 

where Jg{x) = g(—x). In all the sequel, we shall denote by T n (f) the section of order n > 
of T(f) which means that T n (f) is identified with n n T(/)II n where H n is the orthogonal 
projection operator on the Fourier modes 0, . . . , n. The analogue of identity (|1.2p for finite 
section Toeplitz matrices is given by the formula of Widom [13] 

(1.3) T n (fg) - T n {f)T n {g) = U n H(f)H(Jg)U n + U n H(Jf)H(g)Il n , 

where II n = U n e mx JH n . 

The asymptotic behavior of the spectrum of a single Toeplitz matrix, say T n (f), dates back 
to Szego (see the book of Grenander and Szego [S]). However, it is much more difficult to deal 
with the spectrum of the product of two Toeplitz matrices T n (f)T n {g). Several authors have 
investigated the asymptotic behavior of the spectrum of T n (f)T n (g). More precisely, assume 
that /, g € L°°(T, R) with g > and denote by Aq,...,A" the eigenvalues of the product 
T n (f)T n (g). It was shown in pQ and by Serra Capizzano [12] that 
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(1-4) ^I>( A £)^^ / V(f9){x)dx, 

k=o Jj 



for any ip G C U (M). There also exits a wide literature on the asymptotic behavior of the 
determinant of Toeplitz matrices (see Gray [7j for a review). However, to the best of our 
knowledge, no result is available on the asymptotic behavior of the maximum as well as on 
the minimum eigenvalues of the product T n (f)T n (g). 

The purpose of this paper is to prove that the eigenvalues of T n (f)T n (g) converge to the 
spectrum of the limit operator T(f)T(g). In particular, the maximum and the minimum 
eigenvalues of T n (f)T n (g) both converge to the maximum and minimum of the spectrum of 
T(f)T(g). It allows us to deduce a direct application in probability on large deviations for 
quadratic forms of Gaussian processes. 

Our approach is based on semi-classical analysis and scattering theory. In order to prove the 
convergence of the spectrum, we construct quasimodes which are approximative eigenvectors. 
More precisely, we show that eigenvectors associated with the eigenvalues outside the essential 
spectrum are localized in the lower and higher frequencies. 

The paper is organized as follows. In Section we state the main results. Section [3] is 
devoted to the application in probability. Our functional point of view on Toeplitz operators 
and the tools used in the paper are given in Section HI The convergence of the spectrum is 
proved in Section while the rest of the proofs is postponed in Section [6j Finally, in Section 
we propose an alternative proof of Douglas's theorem. 



2. Main results on Toeplitz operators 

According to the identification of L 2 (T) with Z 2 (Z) (which contains Z 2 (N)) by the Fourier 
transform, we can view all the operators as operators on L 2 (T). In this case, is necessarily 
an eigenvalue of infinite multiplicity of each operators T(f), T n (f) (see Section |4~T1 for the 
precise definition of the Toeplitz operators). In this paper, our operators will be considered 
as operators on Imll and Imil n . We shall denote by cr(A) the spectrum of A. We have 

Lemma 2.1. Let f,g£ L°°(T) with g real-valued and non-negative. Then, on ImLT, we have 

cr {T(g) 1 ^ 2 T(f)T(g) 1 ^ 2 ) = a(T(f)T(g)). 

The same result holds for T n on Im II n and the multiplicity of the eigenvalues is the same. 

Remark 2.2. This property is also true for T and T n on L 2 (T). 

Please note that o{AB) = cr(BA) is not true in general. By example, for f(x) = e lx and 
g (x) = e ~ ix , we have a(T(f)T(g)) = {0, 1} and a(T(g)T(f)) = {1} on ImII. 

Assume now that f,g £ L°°(T) are both real-valued with g > 0. Then, T(c/) 1 / 2 T(/)T(g) 1 / 2 
and T n (g) 1 ^ 2 T n (f)T n (g) 1 ^ 2 are self-adjoint and their spectrum is real. Let us introduce the 
maximum and minimum eigenvalues of the product of the Toeplitz operators of finite rank 
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on Imn n 

*2uk(/j0) = max a (T n (f)T n (g)) 
A min(/>5) = m ina(T n (f)T n (g)), 
and the extrema of the spectrum of the product of the Toeplitz operators on Imll 

Amax(/,s) = m axo-(T(/)T(#)) 
A m in(/,5) =mincr(r(/)T(5)). 
One can observe that, in general, we don't know if A max (/, g) and A m ; n (/, g) are eigenvalues. 
Theorem 2.3. Assume that f,g£ C°(T,R) with g > 0. Then, as n goes to infinity, 
Amax(/;S) ► A max (/,g) and A" in (/,C/) ► A min (/,g). 



In fact, we will prove the following result which implies Theorem | 

Theorem 2.4. Assume that f,g£ C°(T,R) with g > 0. For A G R, the following properties 
are equivalent: 

i) X G a(T(f)T(g)), 

ii) there exists X n G o(T n (f)T n (g)) such that X n — > A, 

iiij there exists a subsequence NofN and Xn G a(T]y(f)T]y(g)) such that Xn — > A. 

Remark 2.5. In the previous theorems, the operators T n and T are considered on Imil n 
and on Im II respectively. But, our results are also true if these operators are considered on 
L 2 (T) (we only add the eigenvalue 0). 

As shown in the next example, it is not true in general that A max (/, g) = sup(/g) or 
A m m(/)<?) = hif (/<?). Note also that the norm of T(g) l > 2 T(f)T(g) l l 2 is not always equal to 
I \fg I |oo or 11/ 1 |oo 1 1 5 1 |oo- The situation is totally different from the case of a single Toeplitz 
operator T(f) with real continuous symbol as A max (/, 1) = sup(/) and A m j n (/, 1) = inf(/). 

Example 2.6. Let a, G R with |0| < 1 and consider f,g G C°(T) given by 

/(x) = a + cos(x) and g(x) = — — \ — . 

1 + 9 Z — 20cos(x) 

We have \\f\\oo = |o| + 1 and \\g\\oo = (1 — l$l)~ 2 - The function g is simply the spectral density 
of a Gaussian autoregressive process [lj. If 9 = 0, g = 1 and the product T(f)T(g) reduces 
to T(f). Consequently, A max (/,g) = a + 1 and A min (/,g) = a - 1. If / 0, denote 

(1 + 0) , , (l-^) 

ae = — and 



29 u 29 

We shall show in section [6751 that A m i n (f, g) < 'mi(fg) and A max (f, g) > sup(fg). More 
precisely, if 9 > then A max (/,g) = sup( fg) while 

, , , , 1 ■ en \ . ( a — \ a + 1 

Xmm{j,g) = AQ ,, , — < ml (fg) = mm 



-49(1 + a9) V(l + 0)2' (1-0)2, 

if a &]aQ,be[ and X m i n (f,g) = inf(fg) otherwise. Moreover, if 9 < then A m i n (f, g) = inf(fg) 
while 

» / p \ 1 ,j. s / a- 1 a+1 

Amax(/,5J = 7^7q , — 2TT > su P(/s) = max 



-40(1 + a0) ^ y/ V (1+0)2' (1-0)2 
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if a e]a e ,b g [ and X max (f,g) = sup(fg) otherwise. 



3. Application in probability 



Let (X n ) be a centered stationary real Gaussian process with bounded positive spectral 
density g which means that 



E[XjX k ] = -!- / exp(i(j - k)x)g(x) dx. 
2ir J t 



We assume in all the sequel that g is not the zero function. For any real continuous function 
/ € C°(T), we are interested in the asymptotic behavior of 



1 r n 

(3.1) W n (f) = — / f{x) Y.Xj^viijx 

7171 jT j=0 



2 

dx. 



The purpose of this section is to provide the last step in the analysis of the large deviation 
properties of (W n (/)) by establishing a large deviation principle (LDP) for (W n (/)) in the 
spirit of the original work of [1] or of Bryc and Dembo [4]. We refer the reader to the book 
of Dembo and Zeitouni [5] for the general theory on large deviations. The covariance matrix 
associated with the vector = (Xo,...,X n Y is T n (g). Consequently, it immediately 

follows from (13.11) that 



(3.2) W n (f) = -X^T n (f)X^ = iyW t T n ( 5 ) 1 /2 rn ( / ) Tn ( 5 )l/2y(n) 

n n 

where the vector y( n ) has a Gaussian A/"(0, I n ) distribution. In order to investigate the 
large deviation properties of (W n (f)), it is necessary to calculate the normalized cumulant 
generating function given, for all t G M, by 

L n {t) = - log E[exp(ntW„ (/))]. 

For convenience and in all the sequel, we use of the notation that logt = — oo if t < 0. We 
deduce from (13.21) and standard Gaussian calculation that for all i € M 



L n it) = - ^logdet {I n - 2fT n ( 5 ) 1 / 2 T„(/)T n ( 5 ) 1 / 2 ), 



k=0 



where Aq, . . . , A™ are the eigenvalues of T ra (5f) 1//2 T n (/)T n (5) 1/ ' 2 which are also the eigenvalues 
of T n (f)T n (g) from Lemma ED For all t £ R, let 

L fg (t)=-^ J^og(l-2tf(x)g(x))dx, 

and denote by If g its Fenchel-Legendre transform 



Ifg(x) = sup{xt - L fg (t)}. 

teM. 
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Furthermore, for all x £ R, let 



(3.3) J fg (x) = I 



If g (x) if x £]a, b[ 

Ifg(b) + ox -j- f A x-b) ifxG[6,+oo[ 
^A max (j, g) 



where a and b are the extended real numbers given by 

a = L ' f9 GwT^), 

if Ami n (/,£f) < and A min (/,g) < ial(fg), a = -oo otherwise, while 

1 



6 = L /s 



2A max (/, #) 



if A m ax(/,5) > and A max (/, > sup(/<?), 6 = +oo otherwise. We immediately deduce from 
Theorem 1 of [I] together with Theorem [23J that the LDP holds for (W n (/)). 

Corollary 3.1. The sequence (W n (/)) satisfies an LDP with good rate function Jj g . More 
precisely, for any closed set FcR 

limsup-logP(>V„(/) 6f)< - inf 

ra— >oo W 



while for any open set G C 



ttminf-logP(VV„(/) £ G) > - inf J f „(x) 

n— >oo re xeG 



Remark 3.2. Denote by /j the derivative of Lf g at point zero 

/I = — [ f(x)g(x)dx. 
Then, we have Jt g (u.) = and it follows from Corollarv \3.1\ that for all x > (j, 



whereas for all x < fj, 



lim ilogP(W n (/) >x) = -J fg {x) 

n^oo n 



lim ilogP(W„(/) <x) = -J fg (x) 

n^oo 77, 



4. TOEPLITZ OPERATORS AND FUNCTIONAL CALCULUS 



In this section, we interpret the projection operators TL n and II as spectral projectors of 
the derivation operator. We also introduce the main ingredients of the proofs. 
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4.1. A functional point of view. 

Our approach consists to view the Toeplitz operators T(f) and T n {f) as the cut-off, in 
frequencies, of the operator of multiplication by /. 

To be more precise, let us introduce the Fourier transform, T : L 2 (T) — > / 2 (Z), defined by 

1 f n 

{Tu) k = u k = — J u(x)e~ lkx dx. 

The operator T is an isomorphism. We denote by J-' 1 its inverse, and we introduce the 
projections II and II n as 

ft :Sg Z 2 (Z) i — ► (..., 0,0,Sb,Wi,...) G l 2 (%) 

n n :Sei 2 (z) i— ► (...,o,o,2 ,2i, ■■■,«„, o,o,...) g z 2 (z). 

On the other hand, if we identify / G L°°(T) with L(f), the bounded operator defined on 
L 2 (T)by 

u G L 2 (T) i — L 2 (T), 

we have 

r(/) = n/n and r n (/) = n n /n n , 

with II = JF _1 IIJF and H n = J- H n J-. In the following, we will systematically identify / 
with the operator L(f). 

On the other hand, since j-^(e tkx ) = ke lkx , the derivation operator D defined on 
H\T) = {ue L 2 (T); -^u G L 2 (T)} = {u G L 2 (T); G Z 2 (Z)} 

by 

D : u € ^(T) .— > --^-u G L 2 (T) 
i ax 

is self-adjoint on L 2 (T) and TDT^ 1 is the diagonal operator (kd^^kjez- 

For any bounded Borel function ip, the bounded operator ip(D) is defined with the help of 
the spectral theorem for self-adjoint operators (see Theorem VIII. 5 of It satisfies 

<p(D) = T- 1 ^)^, 

where tp(k) is identified with the operator L((p) 

u G Z 2 (Z) i — ► (..., <p{k)u k , ...)(£ l 2 (Z). 

In particular, if lj denotes the indicator function of the interval /, we have 

ip.+ootP) = 11 and ip.nlC- ) = MOA}^ 1 D ) = n n- 

Moreover, note that if supp(^) C [a, b], and if we identify e tkx with the operator of multipli- 
cation by e lkx , we have the trivial properties 

1 M (D) p(£>) = and 1 M (£>) e ifc * = e ifc * l [a _ fc)6 _ fc] (£>). 

In the rest of the paper, a function is a o^_ >6 (l) if, for each c fixed, the function goes to 
as a goes to b. In the same way, a function is a O c (l) if, for each c fixed, the function is a 
Oil). 



SPECTRUM OF THE PRODUCT OF TOEPLITZ MATRICES 



7 



4.2. A commutator estimate. 

In this subsection, we recall a standard result of the functional analysis. For p G R, we 
denote by £ P (R) the class of functions ip in C°°(R) such that 

\d k Ms)\ < c k { s y- k , 

for k > 0. Here (x) = (1 + [x] 2 ) 1 ^. 

Lemma 4.1 (Lemma C.3.2 of [6]). Let A, B be self-adjoint operators on a Hilbert space with 
B and [A,B] bounded. If <p € S P (R) with p < 1, then 

\MA),B]\\<CJ[A,B]\\. 

Here, [A, B] = AB — BA denotes the commutator. The constant C v only depends on <p. 

Applying this lemma, we immediately obtain 
Lemma 4.2. Let f G C°(T) and <p G S P (R) with p<0. Then 

[<p(eD),f\ = o e -*(l). 

Proof. By Weierstrass's theorem, there exist G C 1 (T) satisfying — > / in L°°(T). Then, 
viewed as operators, we have — > / in £(L 2 (T)). Remark that [e-D,/^] = —eifL. From 
Lemma 14,14 we obtain 

\\[ip(eD)J k ]\\<eCJf' k \\ 00 . 

Then, using that ip is bounded, 

MeD), f] =[<p(sD), f k ] + o^ocCl) = O fc (e) + o fc ^oo(l) 
=o e ^ (l), 

since [(^(eZ)),/] does not depend on k. □ 

4.3. Essential spectrum of the product of Toeplitz operators. 

Here, we recall the theorem of Douglas in our setting. In fact, the result of Douglas is 
true in a more general framework (see [101 Theorem 4.5.10]). We shall give in section [7] an 
alternative proof of the following theorem, more related to our approach. 

Theorem 4.3 (Douglas). Let f, g G C°(T, R) with g > 0. The bounded self-adjoint operator 
T{g) l/2 T(f)T{g) 1 / 2 satis&es on \mli 

a ess (T( 5 ) 1 / 2 T(/)T( 5 ) 1 / 2 ) = [inf (/<?), sup(/g)]. 

Here, <7 eS s(A) denotes the essential spectrum of A. 

In Theorem EES the operator T(g) 1 / 2 T(f)T(g) 1 / 2 is viewed as an operator on Imll. On 
L 2 (T), this operator is a block diagonal operator with respect to the orthogonal sum L 2 = 
Imll 0^ Im(l — n) and is equal to on Im(l — n). In particular, we have 

Remark 4.4. If the operator T{g) l / 2 T{f)T{g) 1 / 2 is viewed on L 2 (T), we have 
f T css (T( 9 ) 1 / 2 T(/)r( 5 ) 1 / 2 ) = [inf(/ 5 ),sup(/5)] U{0}. 
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5. Proof of Theorem 12.41 



The goal of this section is to prove Theorem 12. 41 First of all, one can observe that part ii) 
clearly implies in). In the next subsection, we first show that i) implies ii). 



5.1. The implication i) gives ii). 

Lemma 5.1. Let f,ge C°(T,R) with g>0. Then, 

T^gf^T^T^g) 1 ' 2 T(g) 1 l 2 T(f)T(g) l l 2 

strongly on L 2 (T). If A belongs to the spectrum of T(f)T(g) on Imll, then there exists an 
eigenvalue X n ofT n (f)T n (g) on ImII n such that A n — > A. 



Proof. For a sequence of bounded operators (An), we shall denote 

A n > A, 

if A n converges strongly to A. Since TL n II, it follows from Lemma III. 3. 8 of [9] that for 
all / G L°°(T), T n (f) -U T(f). In particular, from Problem VI. 14 of p] (see also Theorem 
VI.9 of HI]), T n (g) 1 / 2 T(g) 1 / 2 . Consequently, we deduce from Lemma III.3.8 of [9J that 

(5.1) T n (g)V 2 T n (f)T n (g)V 2 T(g) l / 2 T(f)T(g) 1 / 2 , 

on L 2 (T). In particular, we obtain on Imll 

T n ig) 1/2 T n (f)T n {g)^ 2 + M(U - U n ) T(g) l l 2 T(f)T(g) l l 2 , 

for all M G M. We choose /i = ||/||oo||5||oo an d M = /i+1. Therefore, it follows from Corollary 
VIII.1.6 of [9] that 

T n (g)y 2 T n (f)T n (g) l l 2 + M(U - U n ) T(< 7 ) 1 / 2 T(/)T( 5 ) 1 / 2 

strongly in the generalized sense on Imll. 

Consequently, Lemma [2. II and Theorem VIII. 1.14 of [9j imply that, for each A belonging to 
a(T(f)T(g)) on Imll, there exists an eigenvalue A n of T n (g) l / 2 T n (f)T n (g) 1 / 2 +M(U- U n ) 
on Imll such that A n — > A. Since ||T(g , ) 1 / 2 r(/)r(<7) 1 / 2 || < fj,, we necessarily have A G [— fM, fj] 
and then M > |A| + 1. In particular, for n large enough, M > |A n | + 1/2. Therefore, A n is an 
eigenvalue of T n (g) 1 ^ 2 T n (f)T n (g) 1 ^ 2 on ImII n because 

T n (g) 1/2 T n (f)T n (g) 1 / 2 + M(n - n n ) = r n ( 5 ) 1 / 2 r n (/)r n ( 5 ) 1 / 2 © x M(n - n n ), 

is a block diagonal operator with respect to the orthogonal sum Imll = ImII n (B 1 - Im(II — 

Un). □ 



5.2. The implication Hi) gives i). 

Let A at be a sequence of eigenvalues of T^(f)T^(g) such that A at — > A G R. Here iV 
is a subsequence of N and we have to show that A is in the spectrum of T(f)T(g). From 
Lemma 12.11 and Theorem 14.31 we know that [inf (/<?), sup(fg)] is always inside the spectrum 
of T(f)T(g). Thus, we can assume that 

(5.2) \£ [inf(/ 5 ),sup(/ 5 )]. 
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By Weierstrass's theorem, there exists a sequence of C°°(T) functions (/&) such that /& — » / 
in L°°(T) and supp/fc C [—A;, A;]. We also consider (g k ) a sequence corresponding to g with 
the same properties mutatis mutandis. In particular, for all n G N, 

(5.3) T n (f)=T n (f k )+o k ^ 00 (l) and T(/) = T(f k ) + 0^(1). 

Recall that, by definition, a 0^00(1) is uniform with respect to n. 

Finally, let un £ ImlLv be an eigenvector of T^(f)T^(g) associated with Aat and satisfying 
||ujv|| = 1- From (15.31) . 



(5.4) T N (f)T N (g)u N = \ N u N = \u N + oat->oo(1) 

(5.5) T N (f k )T N (g k )u N = Xu N + ojv-+oo(1) + 0fc-+oo(l)- 
In the following, we denote D n = n~ 1 D. 

5.2.1. Localization of the eigenvectors. 
Lemma 5.2. Let if € Cg°(]0, 1[). Tnen, in L 2 (T) norm, 

ip(D N )u N = OAT^oo(l). 

In [2], Bottcher, Crespo and Gutierrez-Gutierrez have established that, for any e(n) > 
with ne(n) going to infinity, 

, . max |IC?n(/fl) ~ T n (f)T n (g))e k || — > 0, 

ne(n)<K<n(l— e(n)J 

where (e&) is the standard basis of Z 2 (N). Here, we will show and use 

\\(fg - T n (f)T n (g))(Ii {1 _ e)n - n en )|| — ► 0, 
in operator norm for all < e < 1/2. 

Proof. From Lemma 14.21 we have 

tp(D N )T N (f) =ip(D N )l m (D N )fl m (D N ) = <p(D N )fl [0>1] (D N ) 
=fif(D N )l[ 0A] (D N ) +OAr^oo(l) 

(5.6) =f(p(D N )+o N ^ 00 {l). 
Applying two times this estimate, we obtain 

ip(D N )T N (f)T N (g)u N = fip{D N )T N (g)u N + oat->oo(1) 

= fgip{D N )u N + Oat^oo(I). 

Then, (f5\4|) gives 

(fg - \)(p(D N )u N = oat^oo(I). 

Since A ^ [mf(fg),sup(fg)}, the function (fg — A) -1 is in L°°(T) and the lemma follows from 
the last equation. □ 

Now, we take if € C^°(]0, 1[, [0, 1]) such that (p = 1 near [e, 1 — e] for e > small enough 
(we choose e = 1/8). Let 99" G C^°([-e, 2e], [0, 1]) and ip+ G Cg°([l - 2e, 1 +e], [0, 1]) be two 
functions such that 

+ f + <p + = 1, 
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in the neighborhood of [0, 1]. Set 

u% = ip ± (D N )u N = ip ± (D N )l[ 0A ](D N )u N . 
As ||itjv|| = 1] it follows from Lemma 15.21 that 

(5.7) \\ujf + = 1 + A r_ +oo (l). 

In particular, we can assume, up to the extraction of a subsequence, that 

ViV ||n^|| > 1/3 or ViV ||u+ || > 1/3. 
In the next section, we will suppose 

(5.8) ||n w || > 1/3. 

The || > 1/3 follows essentially the same lines and is treated in Section [5.2.31 But 

before, we show that and are both quasimodes of Tjv(/)Tjv(5) (this means that they 
are eigenvectors modulo a small term). 

Lemma 5.3. We have 

TN{fk)TN{9k)u% = An^ + o fe ^oo(l) + o k N _ 00 (l). 

Proof. As in (|5.6p . using Lemma 14.21 we get 

TN(fk)TN(gk)u% =l[ 0t i](D N )f k l[ ^(D N )g k l[ 0A ](D N )ip ± (D N )u N 
=1 [o,i] (Av)./fcl[o,i] {D N )g k ip ± (D N )l [0)1] (D N )u N 

=^-[0,l]( D N)fk^-[0,l](D N )ip ± (D N )g k l [0tl] (D N )u N + Oat-^ooI 1 ) 
=^0,l]( D N)^(DN)fkl[0,l](D N )g k l[o,l](D N )u N + O^-ooCl) 

(5.9) =^ ± ( J DA)T 7V (/ fc )T iV ( 5fc ) Ui v + o^oo(l)- 

The lemma follows from (|5.5p and the last identity. □ 

5.2.2. Concentration near the low frequencies. 

Here, we assume ([5.8p and we prove that ujj, viewed as an element of Im LI, is a quasimode 
of T(f k )T(g k ). 

Lemma 5.4. For 4k < N, we have 

T(fk)T(g k )u^ = T N (f k )T N (g k )u^. 
Remark 5.5. In fact, for 4k < N < n, we have 

T n {fk)T n {gk)u N = T N (f k )T N {g k )u N . 

Proof. Recall that, if u, v are two functions of L 2 (T) such that suppn C [a, b] and suppw C 
[c, d] , then supp uv C [a + c,b + d\. By definition, 

(5.10) T{f k )T{g k )u~ N = ILf h H.g k TL(p~(D N )u N = Ylf k Ilg k n N (p~ (D N )u N . 

Since supp^ C [—k,k] and supp Fillx^ {Dn)un) C [0,N/4], the Fourier transform of the 
function g k Ii^Lp~ (Dn)un is supported inside [—k,N/4 + k] C [—k,N]. In particular, 

(5.11) Ilg k n N (p~(D N )u N = U N g k Il N ip~(D N )u N , 
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and the Fourier transform of this function is supported inside [0, N/4 + k] . As before, the 
Fourier transform of 

fk^N9k^N^P~ (D n )un 
is supported inside [—k, N/4 + 2k] C [—k, N]. Then 

(5.12) Uf k U N g k Il N ip~{D N )u N = Il N f k Il N g k Il N <p~(D N )u N . 

The lemma follows from ([5TT0]) . (I5TTT]) et (15321) . □ 

From (|5.3p . Lemma 15.31 and Lemma 15.41 we get 

(5.13) T(f)T(g)u N = \u N + 0^(1) + ojUJl), 

for 4k < N. If A ^ o~(T(f)T(g)), the operator T(f)T(g) — A is invertible and then 

«JV = °fc^oo(l) + O^oo(l). 

From (|5.8p . we obtain 1/3 < 

(1) + o^_ +00 (l). Taking fc large enough and after N large 
enough, it is clear that this is impossible. Thus, 

A e a(T(f)T(g)), 

which implies Theorem 12.41 under the assumption (|5,8p . 

5.2.3. Concentration near the high frequencies. 

We replace the assumption (|5.8p by \\u^\\ > 1/3. Let 

J : J L 2 (T) ► L 2 (T) 

\/(*) /(-*) 
Remark that J(uv) = J{u)J(v). Using the notation H[ a ,b] = l[a,b](D), we have H[ a ^J = 
JH[_b-a] and LT[ a ne lcx = e* ca TI[ a _ Cj 6_ c ] . Combining these identities with Lemma [573], we get 

T N {Jf k )T N (Jg k )e iNx {Ju + N ) =IL [0>N] ( Jf k )Ii [0>N] ( Jfl fc )n [0iAf] e iJVa: ( Ju% ) 

= e i7Va Ti [ _ 7Vi0] ( J/ fc )n [ _ A r i o] ( J5fe)n hiV>0] ( j«+ ) 

=e iA ^II [ _ 7Vi0] (J/ i .)n [ _ JV ,o] (^fc) Jn [0,JVp^ 

=e lNx U[_ N ^ (J f k )U[-N,0] J 9k^[0,N] u N 

=e lNx K[-N,o}(Jfk)J~tt{o,N}9kTli 0:N ]U~^ 
=e lNx U[_ N ^J f k U[o : N]9k^[o,N]U% 

=elNX J^-[0,N]fk^-[0,N]9k^[0,N] u N 

(5.14) =\e iNx {Ju + N ) + o^oo(l) + 0^00(1). 
In particular, ujj = e lNx (Ju~^) satisfies ||n^|| > 1/3, 

T N (Jfk)T N {Jgk)uN = Xu N + o fc _»oo(l) + 0^-^(1), 

and the support of the Fourier transform of is inside [0, N/4]. In particular, we can apply 
the method developed in the case > 1/3. The unique difference is that /, g are replaced 

by (Jf), (Jg). Then we obtain 

Xea(T(Jf)T(Jg)). 



12 B. BERCU, J.-F. BONY, AND V. BRUNEAU 

Theorem 12.41 follows from the following lemma and a{T{f)T(g)) = o~(T(g)T(f)) (The spec- 
trum of T(f)T(g) is real from Lemma 12. II and (T(f)T(g) — z)* = T(g)T(f) — ~z.) 

Lemma 5.6. Let f,ge L°°(T). Then 

a(T(Jf)T(Jg)) = a(T(g)T(f)). 

Proof. For A a bounded linear operator on L 2 , we define A 1 by 

(A t u,v) = (u,M), 

for all u, v € L 2 . Simple calculi give /* = /, Hj afc ] = IL_ 6i _ a ], (AB)* = B t A t and then 

T{ff = (n[o,+oo[/n[o, +0 o[)* = H]_ OOj0 ]/ii]_ OOi0 ]. 

By the same way, since J = J* = J , 

JR]-oo,0]fR]-oo,0]J = n[0 l+O o[(^/)n[0 l+ oo[ = T(Jf). 

Combining these identities concerning * and J, we get 

j(T(j/)T(j< 7 )) t j' 1 =j(n ] _ OOi0] (j< 7 )n ] _ OOi0] )(n ] „ OOi0] (j/)n ] _ OOi0] )j 

(5.15) =T( 9 )T(f). 

Since JA t J—z = J(A — z) 1 J ', A and J A 1 J have the same spectrum and the lemma follows. □ 

6. Proof of the other results 

6.1. Proof of Lemma 12.11 

In fact, we will prove the following result: Let A, B be two bounded operators on a Hilbert 
space. Assume that B is self-adjoint with B > 0. Then 

(6.1) a{AB) = a(B 1 / 2 AB 1 / 2 ). 

Recall that, in a ring, 1 — oh is invertible if and only if 1 — ba is invertible (the inverse of 
1 — 6a is then 1 + 6(1 — a6) _1 a). In particular, 

a(AB) \ {0} = a{B 1 / 2 AB 1 / 2 ) \ {0}, 

and it remains to study the value 0. 

Assume first that € a(B 1 ^ 2 ). By Weyl's criterion (see Theorem VII. 12]), there exist 
u n , with \\u n \\ = 1, such that B l / 2 u n -> 0. Then, ABu n -> and B 1 / 2 AB 1 / 2 u n -> 0. Thus, 
is in the spectrum of the two operators AB and B 1 / 2 AB 1 / 2 . 

Assume now that ^ a(B 1 ^ 2 ). Then, B 1 / 2 is invertible. In particular, AB is invertible if 
and only if B 1 / 2 AB 1 / 2 is invertible. Thus, is in the spectrum of AB if and only if is in 
the spectrum of B 1 / 2 AB 1 / 2 . 

In the case of a finite dimensional Hilbert space, we use the formula 

det(AB - A) = det{B l ' 2 AB 1 / 2 - A). 

In particular, the operators T n (f)T n (g) and T n (g) 1 ^ 2 T n (f)T n (g) 1 ^ 2 have the same eigenvalues 
with the same multiplicity. 
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6.2. Proof of Theorem [231 

Here, we show that Theorem 12.41 implies Theorem 12.31 We drop the subscript (/, g) and 
denote Aii msup = limsupA max . By definition, 

(6-2) A max < Aii msU p + °n—»oo(l)> 

and there exists a subsequence N of N such that A^ ax — > Aii msup . In particular, using the 
implication iii)=>i) of Theorem 12.4} Aii msup is in the spectrum of T(f)T(g) and then 

(6.3) ^limsup ^ A max . 

On the other hand, according to the implication i)=?ii) of Theorem 12.41 there exists A n G 
a(T n (f)T n (g)) such that A n -> A max . Thus, 

(6.4) A max + Orwoo (l) < A n < A max . 
Combining (TO}, ([OD and (f6^|) . we finally obtain A max ► A max — Aij msU p. 

6.3. Proof of Example ESI 

The goal of this section is to study the extrema of the limiting spectrum of the product 
T n (f)T n (g) in the particular case 

f{x) = a + cos(x) and g(x) = ± + Q2 _\ ms{x) 

where a, 9 G M. and \9\ < 1. 

First of all, one can observe that it is more convenient to work with the inverse of T n {g). 
As a matter of fact, T n (g)~ l is a tridiagonal matrix quite similar to T n (g~ l ) except that, at 
the two diagonal corners of T n {g~ l ), the coefficient 1 + 9 2 is replaced by 1 

/ 1 -9 ... \ 

-9 1 + 9 2 -9 

-9 1 + 9 2 -9 
V ... -9 1 J 



T n {g) 



-1 



It is not hard to see that det(T n (g) -1 ) = 1 — 9 2 . In order to find the eigenvalues A of 
the product T n (f)T n (g), it is equivalent to calculate the zeros of its characteristic polynomial 
which correspond also to the zeros of det(M n (t)) where 

M n (t)=tT n (f)-T n (g)-\ 

with t = 1/A. As T n (f) and T n (g)~ l are both tridiagonal matrices, we can easily compute 
det(M n (t)). 

Via the same lines than in [U Lemma 11], we find that for n large enough, M n (t) is negative 
definite only on the domain T> = T>\ U T>2 where 

V 1 = {-29 2 <p<-9 2 and q 2 < -A9 2 {p + 9 2 )} and V 2 = {p < -29 2 and p < -\q\}, 

with p = at — (1 + 9 2 ) and q = t + 29. In term of the variable A, the inverses of the boundaries 
of V give the extrema of the spectrum of the T(f)T(g) i.e. A max (/, g) and A m j n (/, g). After 
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some tedious but straightforward calculations, we obtain three inverses of the boundaries 

a — 1 a + 1 1 

(1 + 0) 2 ' (1-0) 2 ' ~46>(l + a0)' 

Two of them coincide with inf(fg) and sup(fg). It only depends on the location of a with 
respect to -(1 + 9 2 )/(26). The last one can be X max (f,g) > sup(fg) or X min (f,g) < inf(/sO. 
It only depends on the sign of 9 as well as on the location of a with respect to the interval 
[ag,bg]. 



7. An altenative proof of Douglas's theorem 



Let ip € C°°(R) satisfying ip = 1 near [2, +oo[ and ip = near ] — oo, 1]. For e > 0, we have 
on Imll 

T(< 7 ) 1 / 2 T(/)T(< 7 ) 1 /2 =T{g) l / 2 ^eD)TU)^{eD)T{g) 1 / 2 +R e 

(7.1) =T( 5 )VV( £ I))/V^)T(3) 1/2 + Re, 
where 

i? £ = T(< 7 ) 1 / 2 (l _ ip(eD))T(f)iP(eD)T(g)V 2 + T( 5 ) 1 / 2 T (/)(1 - ^(e J D))T(< 7 ) 1 / 2 , 

is a self-adjoint operator of finite rank. Recall that if A > is a bounded operator with 
11^411 < 1, then 

+oo 
J'=0 

where ||1 — j4|| < 1 and X]j>o l c il — 2 < +oo (see the proof of Theorem VI. 9 of [H]). On the 
other hand, Lemma 14.21 implies 

T(g)^{eD) =ILgIl^{eD) = ILg^sD) = UiP(eD)g + o e ^ (l) 

(7.2) =if;(eD)g + o £ ^ (l), 

Then, for a fixed 5 > such that ||T(g)|| < \\g\\oo < $ , we have 
T(g) l l 2 iP{eD) =5- 1 / 2 T(5g) 1 / 2 iP(eD) 

+oo 

=S- 1 / 2 ^2c j (l-T(Sg)y^(eD) 

3=0 
J 

3=0 

J 

=5- 1 ' 2 ^{eD) ]T cj(l - 6 9 y + O j^oo(l) + 0^0(1) 
3=0 

=5- 1 ^(eD)(5g) 1 / 2 + 0^(1) + ^(1) 

(7.3) =iP(eD)g 1 ' 2 + o £ ^{l), 
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since these quantities do not depend on J. Using this identity and its adjoint, (|7.ip becomes 

T(g)^ 2 T(f)T(g)^ 2 =^eD) f g^eD) + R e + o e _o(l) 

(7.4) =T ( /5 ) + i?£ + e£) 

where e £ = o £ ^q(1) and 

R £ = R £ + (4>(eD) - \)T{fg)4{eD) + T{fg)ty{eD) - 1), 

is a self-adjoint operator of finite rank. In particular, e £ is a self-adjoint operator. Since, on 
the image on II, 

iniri(/<7) < T(fg) < max(fg), 

we get a(T(fg) + e £ ) C [min(/0) - o e _» (l), max(fg) + o e _» (l)]. Since R £ is of finite rank, 
we obtain, from Weyl's theorem Theorem S.13], 

<T agB {T(g)V 2 T(f)T(jg)V 2 )=* eK (T(fg)+e e ) C [min(/ 5 ) - o^o(l), max(/g) + o e _*(l)]. 

As the essential spectrum of T(g) 1 ^ 2 T(f)T(g) 1 ^ 2 does not depend on e, we get 

(7.5) (7 ess (T( 5 ) 1 / 2 T(/)T( 5 ) 1 / 2 ) C [min(/ 5 ),max(/ 5 )], 
which is the first inclusion of the theorem. 

Now, let tp G C°°([-l,l], [0,1]) with \\ip\\ L 2 = 1. For x G T and a, (3 G N, we set 
u = a l l 2 tp(a(x - xo))e l P x and v = IlueImU, 
which satisfies \\u\\ = 1. We have 

(1 - II)u =a 1 / 2 l ] _ OCi0] ( J D)e 4 ' 3 Xa(x - x )) 
=a 1 / 2 e i ^ ] _^ ] (Z%(a(x-x )) 
=a 1 / 2 e^l ] _ 00 ^ ] (D)(D + i)- w (I> + i)*V(a(x - x„)) 

(7.6) =0(/3- M a M ), 

in L 2 norm for any M G N. Moreover, for a continuous function £, we have 

(7.7) £u = £(x )a 1 / 2 i P (a(x - x ))e i/3x + o a ^oo(l), 

in L 2 norm. Using that ||T(£) 1 / 2 || < ||^||^ 2 , for all function £ G L°° with £ > 0, we get 
T(f)T(g)v =UfUgUu = UfUgu + ©(a/T 1 ) 

=g(x )UfUu + 0(ap- 1 ) + o a -*oc(l) 
= 5 (x )n/n + ^(a/r 1 ) + o a _oo(l) 
=(/ 5 )(x )nn + O(a/3- 1 )+ O 

(7.8) =(/<7)(*0> + ©(a/?" 1 ) + Oa-oo(l). 

Taking /? = a 2 — > +oo, (|7.6|) implies = 1 + o Q _ KX) (l). On the other hand, (|7.8|) gives 

T(f)T(g)v = (fg)(x )v + o a ^ oo (l). 
Then, (fg)(x ) G a(T(f)T(g)) = a(T(g) 1 / 2 T(f)T(g) 1 / 2 ) f rom Lemma O Therefore, 

(7.9) [inf(/ 5 ),sup(/ 5 )] C a(T{g)V*T(f)T{g)V*). 
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Recall that the essential spectrum of a self-adjoint bounded operator on an infinite Hilbert 
space is never empty. Therefore, if inf(/g) = sup(fg), (|7.5p implies the theorem. 

Assume now that ini(fg) < sup(/g). Then [inf (fg), sup(fg)] is an interval with non empty 
interior. Prom the definition of the essential spectrum, this interval is necessarily inside the 
essential spectrum of T(g) 1 / 2 T(f)T(g) 1 / 2 . This achieves the proof of the second inclusion of 
the theorem. 
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